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ABSTRACT 

This paper presents a theoretical concept of 
evaluation vhich can be utilized by classroon teachers at any level 
in evaluating teacher education prograns in reading. The following 
theoretical requirenents (questions) necessary to develop an 
evaluation plan for the improvement of teacher education prograns in 
reading are discussed: (a) What are your beliefs at present about 
reading? and What do you value? (b) What environnental situations 
exist at present? and What is reality? (c) What types of decisions do 
you want to make this year or this senester? (d) What alternatives 
are open to you? (e) what infornation needs do you have in regard to 
your decisions? (f) How and when will you collect infornation? and 
(g) How will you use the infornation? These questions nay be used to 
develop, inplenent, and evaluate teacher education prograns in 
reading or to develop a basic evaluation design. A seven*iten 
bibliography is included. (Author/PD) 
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IvtlMtlon U thm eollMtlon of InforMtloB to lorvo • guldo for 
•duoatort to Mko iiuitruotloiuil »oll «■ othor typoi of dteliione for 
tho ongoing dovolopBont and Inplonontatlon of toaobor tduoatlon progniw 
(Stuff Itboam, 1969, 1970, 1971; Quba, 1969, 1970; Sort von, 1967; 
Stako, 1967, 1969, 1972). /.ouoiding to W«bttor;t Sovonth Ww Colloglato 
Dictionary , ovaluation noana to "dotormlat or fix tho valuo of". Tboroforo, 
•hat you valuo in roading individually or aa a group of individuala nrho 
aro dovoloping, iaploaonting, and evaluating toaohor oducation programa 
•ill dotoraino to a largo oxtont tho program that roaulta. All too ofton 
thia boliof syatom (%hat you or iko valuo) ia givon vory little attention. 
We either pick up a textbook and aasign chaptera •eek-by-%eek vrithout time 
to consider what our belief a are; %e use the same teata each year without 
knowing what we wanted to teat f nd for wtttt purpose we wanted to use them in 
the program; or we use the same program thrust ( monetarily, resource wiae, 
and instructionally) year after year. We operate by intuition, experience 
or armchair decision making (Roser, 1970). However, research has shown 
that ongoing evaluation is a more useful and rational guide to making 
instructional and program decisions (FSrr, et al. , 1971, 1972; Griffin, 
1973). 

Because this is true this paper deals with seven theoretical 
requii^ments that seem essential to evaluation or "the act of valuing". 
This should assist any planner in developing, implementing and evaluating 
a teachor education progrom in reading. 
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Kvalufttton Qu»<tloM 

To ut« •valuitioa a proeesi of oolite ting inforayition for ukiag 
■oro ratioaal dooisloat based upon «hat you value i you need to anaver 
tho following aeven queationat 

1. What are your belief a at preaent la reading? W&at do you value? 

a. xOnMt environmental altuatlona exlat at preaent? What la reality? 

3* What types of decisions do you v^ant to aake thla year or 
this semester? 

4. What alternatives are open to you? 

5. What Information needs do you %ant in regard to your declalons? 

6. How and «hen «111 you collect Information? 

7. Uo» will you use the information? 

The answers to these questions «111 result In an evaluation plan (design) 
that can be used as a guide for the evaluation of teacher education 
programs In reading at any educational level, (national, state, local, 
school or Individual classroom). Answering the above questions and 
developing an evaluation plan are not easy Jobs, but the answers form 
a continuing basis for developing more adequate programs. In short, this 
type of evaluation is stating beliefs: knowing the environmental situation 
thoroughly; formulating decisions such as instructional ones which would 
include determining goals and procedures, materials, organize ti oca 1 
pattex.is to meet those goals; knowing all alt )rnat Ives (limits - choices) 
you have; collecting data; and systematically modifying a program based 
on thu above. It is cyclical in nature as well as ongoing. 



1. WHAT ARE YOUR pgLHTS AT PRE08NT ABOUT REAPING? WHAT DO YOU VALUE? 

This should bs your initial step in dsvsloping an ovslustion plan. 
For an individual or a t«aa of individuals to bsgin dovaloping a basic 
•valuation plan, thay nust coma to tarns «ith valuta. This nay come 
from many sources such as 1) the experiences of persons implementing the 
program; 2) backgrounds and experiences of lay and professional people 
%ithin the field ynho seem important for program development and imple- 
mentation; 3) expert opinion of personnel In the areas you deem important 
from cities, colleges, schools, universities throughout the area and 
country. Some of these may include knowledge from personnel in national 
and state government funding agencies, school board and public support, 
etc,; and 4) other outside sources including published literature and the 
most recent research data. What you believe as an Individual or team 
of individuals is your guide to action. In this case, «hat you believe 
about reading and reading instruction should be seriously discussed 
and written down (described) initially as well as during the semester 
or year of program development, implementation, ar.td evaluation. It is 
the most crucial, and perhaps the most difficult, of the evaluation 
requirements. 
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a. WHAT KWVIRQNMgWTAL SITmTIOWS EXIST AT PRESENT? WHAT IS REALITY? 

What are th* r««dlng exptotatlona, dMuinds, attltudM and ntada 
of tho child, partnta, teaohera, principtlf, ooordlnatora-oonaultanta, 
auparinttadenta, aehool boards, oollagas and unlvaraitUa, itatt, and 
nation? tVhat raally la raality for you in tho devalopntnt, Unplanentation, 
and evaluation of your teacher education program? Before you can atate 
any type of decision you «ant to make (answer any question) you must 
take into consideration and describe your envircamental aituation, i.e. 
the personnel who will work with you, the cost, the demands placed on 
you from governaont funding or otherwise, physical resources, etc. 
Market analysis and needs assessment for predictive purposes before you 
even start your teacher education programs in reading have often been 
nonexistent, thus, leading to the status quo. Suddenly you find yourself 
in "big business" without all the knowledge and skill necessary to keep 
your head above water. Thousands of dollars which have been available 
and allotted over the past se/eral yoers seou to ha/e '-^on wastod for 
this r3ason. ITov/ funding; is becoming; less and less. How can we use the 
monies allotted more effectively is a critical question in the development 
of teacher education programs in reading? Hopefully, those programs 
that can Justify their existence through adequate evaluation will 
continue and the rest will fall by the wayside. Money should follow 
the adequacy and appropriateness of a teacher education program in 
reading. 
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3, WmT TYPBS or DBCXSX0W8 DO YOU WANT TO HMOt IHXS YBAR OR THIS SggSTlR? 

Thar* tr« 4 typ«f ol deolflona tbtt b« dl«ouis«d briefly 
(Quba «nd Stuff labMta, 1970)} 1) intended tndt - gotli; S) intended 
meane - procedures, methods; 3) carrying through the act ion plan - 
implementationj and 4) extent to «hich goala are being and/or have been 
attained. 

1) Intended ends - goals in reading serve as your guide to action 
and are based on «hat you value (your belief in reading) and the 
environaental situation. What are your program goals, your present 
mission, top priority in training reading teachers? 2) The means to 
attain these goals are the selected procedvres, materials, organizational 
pattezDs, personnel, schedule, facilities, money, etc. that can be 
utilized based on the limitations of reality. In actuality, the above 
question means: based on your beliefs about reading and reading 
instruction, what do you «ant to teach, «hen,ho«, with what materials, 
organizational patterns, personnel, time, facilities, and money. Why? 
Your goals should relate directly to your beliefs and the environmental 
situation (reality). The goals for preparing teachers of reading 
should also consider the demands placed on reading teachers. What do 
teachers of reading do? vmat do teacher trainers think they need to do? 
What do teachers think they should know and do to be able to teach 
reading? Those responsibilo for the development, implementation, and 
evaluation of teacher education pzx>grams should constantly study these 
and similar qiestions. 3) Implementing decisions result in asking your- 
self questions such as the following during the ongoing process of the 
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progMtt) Should th« tUff he retrtinod? Should tho goals bo aodlflod? 
Should now proooduros be Instltutod? Should addltlonAl rosourooi 
bo sought? Should stall rosponsibllltlos change? Should nodllloatlon 
be uiade In the schedule, etc.? This Is really the day-to-day operation 
ol the prograa* 4) The last - the extent to which goals have been 
attained - touches on evaluation which should occur continuously during 
program operation. Questions which would evolve would be: Are the 
students' needs being not? Are rroblems being solved as intended? Is 
the program lalllng? Was tha outcome worth the investment? Has sullicient 
progress been achieved to warrant continuation ol the pzt>gram, etc*? 



m con WMUM 

4. WHAT ATJIWmTIVBS AM OVW TO YOU? 

Bia«d on what you valuo, tho tnviroiUMntal iltuitlon, and what you 
want your taaohor aduoatlon pvograa In rtading to bo^ you muat 
dotarmlno availablo alternativaa for naoting tho dociaiona you havo 
tentativoly oada. Thaao aXtarnatlvoa ara oontrolXod by tho poraoanol 
with whom you work, your aohool, achool ayataa, atate, or nation. Svory 
decision you aake haa aome type of limitation. I) Your intended goala 
depend on the amount of Information you have to make them baaed on 
knowledge of reading and the environment. 2) Your means to attain your 
goals have limits in terms of procedures, materials, organisational 
patterns, personnel, facilities, schedule and money; 3) Implementation 
with constant feedback to change during a program operation takes time, 
willingness, and open-mlndedness on the part of all personnel; 4) 
Attainment of goals takes the same strength as number 3 with the 
objectivity to look at program and try to make valid decisions in terms 
of continuing, modifying or discontinuing. The alternatives are really 
your choices — » the limits of your situation. They limit the full 
implementation of your goals just ma your belief system limits full 
accomplishment of your goals, but that is reality. No one can do more 
than his/her velues allow or more than he/she is willing to learn and 
to modify. The necessities of 1) Interrelationships among values, envir- 
onment, goals, and alternatives end 2) personal willingness to search 
for alternatives to means of attainment which will assist in modification 
of goals and means based on values and reality cannot be over emphasized. 
If a program planner or planners are not open to modification or to 
search and extension of alternatives, the program remains the same, and 
he/she has forfeited the goal of continuously improving teacher education 
programs in reading* 
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5. WUT nPORW^TlOy NKBDS CO YOU HAVB IN RBOARP TO YOUR DBCI8I0N8? 

What do you want to know about your goals? How woll you mat than? 
Should you continua than? Should thay ba noditlad partially or 
complataly? 

What do you vant to kao» about tha aaana of attaloMnt of thasa 
goala auch aa aalaotad prooaduras, matariala, organisational pat tarns, 
personnal, tins, facilities, monay, etc. Major question could include: 
Are each related specifically to ny goals? Do I have enough personnel 
to do the Job? Too little peraonnel to do the Job? Xa the time 
allotment appropriate? What about facilities? What about money? Have 
I used my money most effectively to implement a teacher education program 
in readings Have the procedures I've selected been appropriate or 
should they be altered to meet the same goaA? What :ypes df materials 
do I really need, presently have available? How can I spend money 
most effeciently on materials? What organizational patterns work most 
eff actively with my teacher education program. These are but a few of 
many questions you may ask about each decision to get at information 
needs necessary to begin to select appropriate ways of evaluating a 
teacher education program In reading. This step sets the stage for 
planning evaluation. 
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6. HOW AND VHEN WILL YOU COLLECT IHFQRMATIOK? 

Af ««t MBtloncd InitUlly, •valuation it • eontlnuoua prooMa of 
eoXlaoting infosvatioa to serva aa a gulda for aducatora aaking daclaloaa 
for tha oagoing davaXopmant and lapXamantation of taachar aduoatlon 
progiana in raading. Evaluation, in propar proapactiva, ia aat up aa 
tha aixth thaoratioaX roquiramant in tha prooadura for davaXoping an 
avaXuation pXan. Notiea that no daciaion in ragard to how and «han to 
coXlect Information ia nada bafora aarioua conaidaration la givan to 
beXlefa, envlronmentaX aituationa, goaXa, aXternatlvaa, and Infomation 
needs. These sot the franework for the deveXopnent of an evaXuation 
plan which wlXX asalat in the deveXopment of aore vaXld data coXXeotion 
nethoda that produce inforoation to ana»er InitiaX daeiaions. 

Stake (X972) uses a tezn which aeena to fit the theoretlcaX position 
we are trying to make; It Is tezned "responsive evaXuation". Responsive 
evaXuation focuses on aXX the activities going on within a program to 
see "how It ticks". The evaluator observes and records what is happening 
and at the same time finds out what within the program is of value to the 
program implementers. He states that the first duty of any evaluator 
Is to offer program implementers a comprehensive portrayal of the 
program. The usuaX way of evaXuatlng educational programs Is to X) state 
goals; 2) use objective standardized normed tests; 3) check gain by 
comparing our sample to the norm; 4> use standards held by program 
personnel; and 5) report In "research- type" reports. Stake sees "responsive 
evaluation as what people do naturally In evaluating things - observe, 
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r«oord, tnd rttet, Ua would lik« to build • ttolmology t round this 
natunl behavior trying to overooB* iti d«f«oti in tanpling tnorf 
and find ways to authantioata tha "^aas aciantifio" way of reporting. 
Wa buy this type evaluation. It improves cooaunication with personnel 
and is based on direct experience in a realistic setting. It seens to 
aake nore sense in educational decision making. 

Rinebard (1973) siiggests that advocate teams - groups of people to 
help create and select alternatives to program decisions are very 
successful in helping program implementers improve teacher education 
programs in reading. 

Sometimes the implementers of programs become so involved in what 
they are doing that they need outside help in creativity. In a monograph 
to be published by the National Council of Teachers of English on Reading 
Assessment and Instructional Decision Making by Richard S. Venezky (1974) 
ten "canons" are presented in which he relates assessment to decisions 
which are made In the selection, implementation, and evaluation of 
reading program. Some of these "canons" that blend with our position are 
the following: 

1. Streamline evaluation. If there are no decisions to be 
made, there is no need to assess. Ihe need for the 
decision must be established before the assessment 

is done. 

2. Validity of assessment is critical. The content of 
assessment should be compatible with the content 
of each decision and liiformatlon need fox that 
decision. 

3. Work toward precision In assessment. "Cruder" assess** 
ments may be better to assess Instructional needs in 
reading than standardized survey and diagnostic tests 
in reading, A norm grade equivalent doesn't give a 
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taaohdr much to nak* Instructional dooltiona for 
raadlng. Schools seriously concemtd about quality 
rsadlng programs «lll expsnd tha rasourcas raqulrad 
to davolop tha kind of program which will beat fit 
the needs of the students and the abilities and 
resources of the teaching staff and community. 
Selection of assessment comes AFTER decisions on 
what to teach and with what materials, etc. 
Instruction can never be baaed on a certain test. 
A test can never furnish Infoivatlon required for 
building a successful reading program by Itself. 



This may be a new view of evaluation for many of you • much broader 
In scope than familiar testing procedures. It takes more time this 
way than to pick up a test and probably find out Invalid Information 
for making program decisions. However, we think It Is a more rational 
and realistic guide to decision making. This type evaluation should 
occur before. Initially, during and mixer the teacher education 
program in reading. Only In that way do you have a continuous, cyclical 



process 
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7. HOW WlIJi YOU USB THE INFOfflttTICW? 

Vb9 of the Information Is a thoughtful activity which utilises 
the eacperiencea and insights of creative program planners. It is based 
on beliefs, reality, goals, procedures, materials, and organization 
to meet those goals, facilities, personnel, cost, alternatives and 
infoxnatlon needs for each, data collection methods, results, and 
modification of all of these as a result of collected infonnation. The 
most common error in beginning stages of evaluation is making the most 
obvious decision indicated by the collected infomation. For example, 
if students rate a particular activity as poor, the most obvious 
decision is to drop it. However, Instead it may be useful to consider 
ways to Improve the activity, because further data collection might 
Indicate that this is the only possible activity to help students meet 
a particular goal. 

It is very Important for a program planner or instructor to realize 
what he/she does or does not control. £lther will be more effective 
if other people (e.g. lay professionals, parents, students, etc.) are 
given power to control factors which play a part in their learning. Other 
people like to exercise some control, but they also want the program 
planners to know what will exist in their learning. It is helpful to 
strive for a happy balance. 

Venezky (1974) states that assessment results should be limited to 
those prepared to use them in decision making. All data irrelevant to 
decision making for the program should be discarded. Also, the form in 
which assessment results are reported should be determined by the decisions 

ERIC 
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which thoy are to aid. Decisions need to be made in who needs help in 
what. Reporting of class averages, percentage scores is somewhat super- 
fluous and misleading* A teacher education program in reading never 
ends. The process of assessment must, at the same time it produces a 
product, also provide data which can be used to improve the process 
itself. To say it very simply. To continuously evaluate teacher 
education programs in reading one must have a thorough understanding 
of what the program is including all its components, be adaptable to 
changes in children's backgrounds and interests, and continually monitor 
over time so that everyone can be adaptable to change. Change isn't 
a quick procedure. And don't forget, it is so important to know at what 
cost a teacher education program was effective. In other words, don't 
put «ll your eggs in one basket and expect them to transfer thiroughout 
the school system, district or nation. Also, the success of any program 
takes more time than many federal funding agencies will allow. We must 
report "gain" scores from standardized tests on a yearly basis. But 
to make such decisions as to continue or not continue funding on the 
basis of only assessment scores such as nom and gain scores is not 
sufficient. These results must be evaluated in relation to a set of 
realistic expectencies, and It is in the setting of these expectencles 
or goals for a program that extreme difficulty is encountered. We really 
don't know what a successful program In reading should or must contain, 
how much effort is required to Implement it, and what results should 
be expected from it. We must ask ourselves whether or not the goals 
which the program attempted to reach were realistic for the time period 
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Set realistic expectations and assess as needed realising 
that "progress" however you define It to be Is slow. Also, strive to a 
more natural life-like way of evaluating - less "scientific" perhaps, 
but more responsive to the understanding of a teacher education program 
In reading and the needs of a particular set of people. 
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